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(54) METHOD AND APPARATUS FOR PROVIDING USER SELECTED ADVANCED CLOSED 
CAPTIONS 

(57)Abstract 

PROBLEM TO BE SOLVED: To provide a closed caption 
function which is advanced through the use of existing 
closed caption information which is carried in a TV signal 
in a closed caption producing apparatus. 
SOLUTION: A user is permitted to neglect a closed 
caption expression format which is selected by a 
producer (e.g. a programmer or a broadcaster) in order 
to select another expression attribute based on the 
taste of the user concerning user customizable 
advanced closed caption performance. Besides, another 
form of text information (e.g, subtitles) is customized so 
as to consider preservation, continuous retrieval and 
review. The provided method and apparatus are 
independent of the type of a distribution network, a 
contents format and a receiver type. 
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Km* ASS MMMrUS FOR IB* fROV IS IDS OF USEt.SEUCHD ADViNCED CIO 
SED CAPTIONS 
2 Clain; 

1. A method &r provisfoo of user selected advanced closed captions, cooaprising &e 
steps o£ 

extracting cloeed cotton information from a television signal hsviog 
coirespo tiding television programming; 

deteimfoing whether one or more ttscrsefe^aUrilxUM hovebemsrt; 

applying at least one selected attribute to at kast a portion of the dosed 
caption infonnation; and 

displaying foe closed caption information on a display device in accordance with 
the user selected attributes via a graphical overlay on top of the television programming. 

2. A method in accordance with daira 1, whercm: 

die television signal is received, demodulated, and dteacrambkd prior to said 
extracting of said closed caption in&nn*tk»L 

3. A method in acconlanoe with claim 1 or 2, wbarafo the user selected advanced closed 
caption attributes are applied to closed caption information received via one of a 
ddiveiy network, a personal versatile recorder (PVR), a set-top terminal, a digital 
television, a personal computer, » video cassette recorder, a digital video recwdcr, or a 
digital video did player. 

4. A method in accordance with one of claims 1 to X wherein the provision of user 
selected advanced closed captions occurs at one of a personal versatile recorder (PVR), 
a senop terminal, a digital television, a persona) compute; a digital video recorder, or a 
digital video disk player. 

5. A method in accordance with one of claims I to 4, wherein the user selected attributes 
comprise ad least one of font size, font type, foot color, caption window position, caption 
window afee> prim direction, scroll direction, scroll rate, text opacity, background 
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opacity, text justification left, text justification right, uad justification center, and 
background cote*. 

6. A method in accordant* with one of claims 1 to 5, wherein: 

the clcaad caption information is displayed in one or more closed caption boxes. 

7. A method hi accordance with daara 6, wherein multiple closed caption boxes aro 
displayed simultaneously. 

8. A methodic accordance with one of claims 1 to 7> wherein: 

the closed caption information is tagged wife an Identifier tfcat distingm Acs it 
from television programming (fata; and 

the closed caption ^formation is extracted baaed on the identifier. 

9. A meJbod in accordance with one of chums 1 to 8, where m; 

the television signal comprises bo MPEG-2 transport stream; 
the closed ayden information is carried in a iiaer data field of video data syntax 
of the transport scream; and 

Hit closed caption inihitnation is extracted baaed on the user data field, 

10. A method in accordance with one of claims 1 to 9, wherein said closed caption 
information comprises one of EIA-60B olosed caption Information or BIA-708 closed 
caption information. 

It A method in accordance with one of claims 1 to 10, wherein the user selected 
attributes are entered via at least one of a pop-up menu, a dialogue box, and a puD-down 
window menu* 

1Z A method in accordance with one of claims I to 1 1, further comprising the step o£ 
storing die user selected attributes ui meowy. 
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1 3 . A method in accordance with one of claims 1 to 12, further comprising die steps oft 

dynamically determining the locatioo of cm or mote objects ofintcsixtina 
displayed television aoetie; and 

automatically adjusting at least one of (he user selected attributes to make the 
presence of the displayed dosed caption information kit distracting baaed on the 
3ocation of the one or maze objects off interest 

14. A method in accordance with one of claims I to 13, comprising the further step o£ 

storing the dosed caption intonation m memory. 

1 5 » A method u> accordance with claim 14, wheteia the closed caption information is 
stored on one of a personal versatile recorder, a digital television* a digital video 
recorder, a digital video disk player, » wt-top terminal, or a personal computer. 

16, A method in accordance with claim i4or l$ t wherein the user selected attributes 
include the optica of automatically generating a transcript of die television 
programming from the stored closed caption isfonuatiaa, . 

17. A method in accordant* with claim 16, comprising the further step of printing the 
transcript* 

l&AmethodinaoconbfVoetnUaneofdaimB 14to 17,coniprisij^thefmtherstcpo£ 
providing user controlled replay of the stored closed caption information. 

i% A method in accordance with one of claims 14 to 18, ooraprisiag fee further step of: 
providing onscreen raviaw of ckxssd caption tat from the stored closed ci^aioii 
information. 

20. A method in accordance with one of claims 1410 W, comprising the ftathw 



inserting imo (he stcar^d closed caption fafcrrnwrifln at least one of page sombera, 
time ami date of storing, and television program We. 

2L A method in accordance with ant of claim* 14 to 20, caropri&i&s the farther step of 
transferring closed caption text from the stared ci wed caption information to writeahle 
media. 

22 . A method is accordance wife one of claim* 14 to 21, comprising (be further *t*po£ 

transfctringd^^ to 
one of a printer, a personal versatile recorder (PVR), a digital television, a digital video 
recorder, a digital video disk player, a set top terminal or a peroral computer. 

23. A method in accordance with one of claims 14 to 22, comprising the farther step o£ 

providing file manegenwat functions for multiple atored dosed caption fibs, 
wherein each stored doted caption file corresponds to a single television program. 

24. A method in accordance with claim 23, wherein said fifc manaBanejU functions are 
provided by one of a persona) versatile recorder, a digital taJevisJon, a digital video 
recorder, a digital video disk player, a set-top tanninal, or a persona] computer. 

25. A method in accordance with one of cleteu 1 4 to 24, comprising (he ftmbcr ateps of: 

providing for the insertion ofbwfcmarb into cloeed caption tsxt of the stored 
dosed captioo information; and 

providing for the location of die bookmarks inserted into the closed caption tort. 

26. A method in accordance with one of claims 1 to 25, comprising the further stop oft 

removing displayed closed caption information after a predetermined time period 
in which no closed caption infbmiutiou is received* 

27. A method in accordance with one of data* I to 26, comprising the farther stop o£ 
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providing dynamic adjustment of dosed caption text color wtao a transparent 
closed caption background is selected 

28. A method in accordance wftfc ace of claims 1 to 27 \ comprising the further step oft 

utilizing Unicode character technology for imemattoofllvfttian of dosed caption 
information. 

29. A method in accordance with one of claims I to 28, comprising the farther stqp of 

receiving an Emergency Alcn Signal; end 

automatically cvemdtng tbe user delected attribute* in enter to avoid ovcriap of 
die displayed dosed caption information with a display of (he Emergency AJert SigaaL 

30. A method in accordance with ooe of claims 1 to 29, wherein the user selected 
attributes can be disabled on at lean one of a per program basis or a porcbannd basis, 

3 1 . Apparatus fl* provision of tuer selected advanced dosed caption*, cusqxisi^g: 

a processor fen 

extracting closed caption information from a 
tdevision signal having corresponding television prognnitfoing; 

dctcmrioing wbetfi£r one cr roore ustr selected attributes have been set; 
a dosed caption driver for applying tt test one user selected attribute to at least 
a portico of the closed caption Information; 
a display driver; and 

a graphics processor for displaying the closed caption information received ftom 
Ac display driver on a display device in accordance with the user sdected attributes via 
a graphical overlay on top of the television pcopanuning. 

32. Apparatus in accordance with d&iot 31, further comprising; 

e receiver for receiving the television signal; 
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a demodulator far demodulating the television si&iftl; end 
a dcserj&mbler for dcecnunbling (he television aigial* 

33. Apparatus in accordance with claim 3 i or 32* wharom the naer selected advanced 
closed caption attributes ore applied to dosed caption faifimmdoo received via one of a 
delivery network, a personal vmatrte recorder (PVRX a Bet-top terminal, a digital 
talevisioo, a persotud computer, a vufco cassette recorder, a digital video recorder, or a 
digital video disk player. 

34. Apparatus in aeooidanoe with owi of claims 31 to 33, wfaajtrn the apparama 
comprise* one of a personal versatile recorder (PVR), a digital television, a digital video 
recorder, a digital video disk player, a set top terminal, or a peroral computer. 

35. Apparatus in accordance with one of claims 31 to 34, wherein the user selected 
attributes comprise at teaat one of font sto*, font type, font color, caption window 
position, caption window size, print direction, scroll direction, scroti rate, teat opacity, 
background opacity, text justification left, tot justification right, text justification 
center, end background color. 

3<J. Apparatus in accordance with one of olainw 31 to 3 5, whereto: 

the closed caption infonnatkm is displayed m ooae or more closed caption boxes. 

37. Apparatus in aooofdance with claim 36, wherein multiple closed caption bate* are 
displayed suBultaaeaasly. 

3$* Apparatus in accordance with one of claims 31 to 37, wherein: 

the closed capt ton tnfbnnation is tagged with an identifier that dis tingui she* it 

from television programming data; and 

the closed caption information is extracted baaed on the identifier. 
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39. Apparatus in accordance with one of claims 31 to 38, wherein: 

the television signal comprises an MFEO-2 transport stream; 
toe closed caption information U carried in a user data field of video data syntax 
Of the MPEG-2 transport stream; and 

the cJoecd caption information is extracted based on the user data field 

40. Apparatus fa accordance with one of clarma 3! to 39, wherein emd dosed caption 
information comprises one of BIA-608 dosed caption information or EIA-708 closed 

v&pvOQQL ISJQfltt&XiOsL 

41. Ap|Urttw in accordance with m 

attributes are entered via at least one of a pop-up menu, a dialogue tax, and & pull-down 
window menu, 

42* Apparatus in accordance with one of china 31 to 41* farther comprising: 
a memory d evice for storing the user selected attributes in memory. 

43. Apparatus in accordance wi* claim 31, wherein: 

ihe location of one or more object* of interest in a displayed Television ecrae are 
dynamically determined; and 

at least on* of the user selected attribute? is automatfcaBy adjusted to make the 
presence of the displayed closed caption information lea distracttog baaed on the 
location of the one or more objects of interest. 

44. A method in accordance with one of claim* 31 to 43, Anther comprising: 

memory for storing the clued caption tnftrnnatioa 

45. Apparatus in accordance with claim 44, wherein the apparatus comprise* one of a 
pergonal versatile recorder (PVR), a digital televisions, a digital video recorder, a digital 
video disk player, a set top terminal, ore personal computer. 
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^.Apparatus in 

include the option of automatically generating & transcript of the television 
programming from the stored closed caption infomatiosL 

47. Apparatus in accordance with claim 46, wherein flic transcript is pria&xL 

48. Apparatus to attOfltece with one of claims 44 to 47, wherein user controlled replay 
of the stored closed caption infartnatior) is provided 

49. Apparatus in ooooManoc wth one of claims 44 to 48, wtartin onscreen review of 
closed caption text from the stored closed caption iofonnatfon is provided 

50. Apparatus iDaccwdwroe with one of ctei»*44 to4&, wfercin at least one of page 
numbers, time and date of storing and television program title is inserted into the stored 
closed captba mfojmwio©. 

51. A method id accordance with one of chums 44 to 50, wherein closed caption text 
torn the stored closed captiemfofojn^^ 

52 . Apparatus in accordance with one of claims 44 to 5 1, wherdn closed caption text 
from the stored closed capti&a infomjauoa ifi transferred to one of a printer, & personal 
vcrsatOe recorder (PVR), a digital television, a digital video recorder, a digital video 
disk player, a set top terminal, or a personal computer. 

93, Apparatus in accordance wifc erne of claims 44 to 52, wherein tibo processor 
provides file management function* for multiple stored ctarod caption files, whezeni 
each stored dosed capdoo flleccwespcmd$ to a sltiglc tek*i*c& program. 
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54, Apparatus in accord sac* with data) S3, wherein said apparatus comprises one of a 
personal versatile reoardcr* 8 digital tdevisira, a digital video recorder, a digital video 
disk player, a set*top wiwnal, or a pergonal computer, 

53» Apparatus in oecorfanoc with ooe of clams 44 to 54, wherein: 

insetting of bookmarks into closed caption text oft ho stored dosed caption 

information is provided for; and 

locating of the bookmarks inserted into closed caption text of the closed caption 

information is provided for. 

56, Apparatus in acowdanoe with one of claims 3 1 to 55, whereto the displayed closed 
caption information is removed after a predetermined time period in which no cloe*d 
caption information is received 

57, Apparatus in accordance with one of claims 31 to 56* wherein closed caption text 
color is dynamically adjusted when a transparent closed caption background is adetttd. 

58, Apparatus b accordance with doc of claims 51 to 57, wherein Uoicotte character 
technology is utilized fter Imerowioswliatran of closed caption mfiKittation 

59. Apparatus in accordance with ojie of claims 31 to 58, Wherein: 

in the event an Emergency Alert Signal is received, the user selected attributes 
are automatically overridden in coder to avoid overlap of die displayed closed caption 
information with a display of the Emergency Alert Signal, 

60. Apparatus in accordance wife one of daiaw 31 to 59 ( whonb the user selected 
attributes can he disabled on at least one of a per program basis or a per chacoel basis . 

61. A method for the provision of user selected advanced closed captions, comprising 
the steps o£ 
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extracting the closed caption infoimarion from a television signal having 
associated television programming 

dctcnninlng whether one or more twer selected attributes have been set; 

applying at least one user selected attribute to at least a portion of the closed 
caption information; 

diaplajfag die closed caption information on a display device in accordance with 
the user selected attribute* via a graphical overlay on top of die television programming; 

dynamically determining the location of one or more objects of interest in a 
displayed television scene; and 

automatically adjusting at least one of the user selected attributes to make the 
presence of fee displayed closed caption informatics less distracting based on the 
location of the one or more objects of interest. 

62, Apparatus for the provision of user selected advanced dosed captions, comprising 
a processor for: 

extracting the cltf&d caption information from a 
television signal having associated television programming 

detenxrirrittg whether one or owe user selected attributes have been set; 
a closed cation driver for applying at least one us*r selected attribute to at least 
a portion of the closed caption information; and 
a display driven 

a graphics processor fox displaying the dosed caprice information received from 
(he display driver on a display device in accordance with the tuer selected attributes via 
a graphical overlay on top of the television programming; 
wherein: 

the location of one oar more objects c£ interest in a displayed 
television scene are dynamically dctemuned; and 

at least one of die user selected attributes is automatically 
adjusted to mate the presence of the displayed closed caption information lass 
distracting based on die location of the one or more objects of interest. 
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the present invention relates generally to the provision of dosed captioning for 
television find other eudbvtaal programming. In particular, the peseta invention provides 
advanced dosed camion fraiures usaig existing closed caption bfcmotinn earned in the 
television signal. Th* mventico allows a user to override the dosed caption presentation 
ftnnaasKkcu* by the originem (e*, p^gamirworbroadcastw), in order to select 
altercate presentation attributes based on the user 1 ! preference. User customizable advanced 
cb^dcajrtionfcatu^ 

position, caption window axe, print direction, scroll dtactloa, scroll rate, text opacity, 
background opacity, text jaariftcotion left, te» Jostlficatfon right, text jusrScricn center, 
background color, and the like. 

Closed caption* are captions thai are hidden In the video signal Recovery of closed 
caption* for display along with the television p^grammkg requires a closed caption decoder 
to be used in connection with the television receiver. 

Beginning around 1980, dosed captioning of video programs m the United States 
utilized Line 21 of the Vertical Bleating Interval (VBI) of a National Television Standards 
Committee (NTSC) television signaJ to carry closed ceptien dats> b 1990, Congress passed 
the TV Decoder Circuitry Act, which required closed caption decoder* in most television 
receiver* The TV Decoder Qicuiay Act required the Federal Ctramunications Commission 
(FCC) Co produce standards for dosed caption decoders. The FCC f assistance from th* 
Electronic Industrie* Aasoriaiion (EIA) Television Data System* Subwwmhtce, ha> 
developed certain standards for the delivery of closed caption* indndmg the ElA-608 and the 
EIA-708 stand wds. One technique fcr cojnmnnLcxttDg VBI data, &ucfa as closed captions, in 
digital tekvisba dam streams is dbdnsad in commonly assigned VS. patent no. 5,844,615, 
entitled Communication of VBI Data in Digital Television Date Streams, incorporated herein 
by reference 
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Tht EIA«d08 standard, developed in 199 | t is based on the Line 21 system find utilizes 
the DVS-15? standard for carriage format of the ElA-608 captions m digjia] cable system 
DVS-157 is a standard ft* has been established for (ho cable Indasfly by the Digital Video 
SubcommJttee (DVS) of (be Society of Cable Iciceomnnmieatione Engineers ("SCTE"). The 
EIA-60S closed captions are provided ina single, unaftej^cqofifiintfoii 

Tlie EIA-708 standard is a new standard whith was developed Iflreeent years and 
which wflfcw tbe carriage foimat specified in the Advanced TeievktatrSystcm Committee's 
(ATSQ A/33 standard for digital video. Tie BA-708 standard is meant to provide 
"advanced* closed caption features in digital tdcvisioo signals at the Closed Cfcptioxriog 
origination device. The EIA-708 "ndvanced^ feature* include, but are not limited to, die 
ability to change certain closed caption features, soch as the location of the dosed caption 
display , end the *i ze and color of the dosed caption text 

The A/53 format used by the ETA-708 standard Is not backward compatible with 
existing digital cable system* Minions of existing set-top tenahals currently in use by 
consumers suppoiT the EIA-60S standard tscicd digitally in DVS-1 57, These set-top 
terminus arc incapable of being upgraded to accommodate the A/53 format utilized b the 
EIA-708 standard. Rcpiaring the existing set-top terminal* whh EIA-708 compatible systems 
would be cosily to consumers and operators alike. 
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SUMMrtft Y Qf THE INVENTOi 



The preheat invention rriatw generally 10 the provision of closed captioning for 
television and other aodfc»visual prcjuimming. fn particular, the picieat invention ptovides 
user customizable advanced dosed caption tenures using existing dosed caption information 
curled in the television signal The user customizable advanced closed caption features 
include features such as font size, font type, fool color, caption window position, caption 
window stoe> print direction, scroll direction, scrcM ois, ten cpadty, background opacity, 
textjnaificanon lefl, text justification rfgH tew jnBtfficatien center, background color, find 
the tfce. Closed caption tofoimarion is extracted (e*, by a closed caption processor) from a 
television signal, which television signal also oontams corresponding tetevbtan prognanroing. 
The processor diamines whether one or more user selected attritacs have been iet. At least 
one user selected attribute is applied to a less: a portion of the closed caption information 
(e.^ via ^ closed caption driver). The closed caption information is displayed (e.*, via a 
display driver and graphic* processor) on a display device (e.$>, a tdev&oo screen) in 
accordance witfc the nser selected attributes via a graphical overlay on top of the television 
programming. In this moons; user selected advanced dosed caption feature* em be provided 
at the display device using existing closed caption infonnation contained within the 
television aignaL 
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DBTAiLFI) HESCRlMtON OF THE MV?CTQM 

The ensuing detailed description provides jjctfened txan&ery ambod&nezits only; end 
is not Intended to limb the scope, applicehlluy, or cteifigureiion of the invention. Ratho; the 
ensuing detailed description of the preferred exemplary erabnAments will provide those 
aldlledfatheartwiihimen^ 

invention, U should ht understood tbftt various changes may be made intric&nction and 
arrangement cf elements without departing from the spirit end scope of the invention a? set 
in the appended claims. 
The invention Is described io connection with closed caption infbnnation, vriricfa 
should be tmderswed to include not only closed caption wxt, but also «^<^ W^«wn 
necessary for the display of dosed caption*, inducting but sm limited to contextual and 
k^ticd Lxftnnafoa 

invention is not limited to customizing cf traditional closed capital iofcnnatioiL 'Hie 
invention can oho be Impkmwmed to allow fbt cuturaization of any type of textual 
infennadon contained within cx associated wifoe video signal, such as subtitle node tickers, 
advertising bannecs, enserfency alen signals* and the like. 

Figure 1 is a block diagram of en exemplary emfcodfaneru of the present invention* A 
television signal 10 containing cfcaed caption inform alien and asscdmed television 
prograjsmlng Is provided to a processor 20. User selected dosed caption artrifoi** 1 2 are also 
provided to the processor 2a The processor 20 extracts the closed caption information. The 
user selected attributes 12 are applied to at least a jxntioo of ^ caption 
afonnadon by a closed caption driver X). A display driver 40 provides the closed caption 
information with user selected attributes to a graphics processor 4$. The graphic* processor 
43 provides the closed caption information with the user selected attributes applied thereto to 
a display device 50. The closed caption driver 30 aod the display driver 40 may be 
impternenied, as software or firmware ©n or assodatrt^tte 
graphics processor 45 is implemented in hardware and Grnmre. 



(25) ^32003-9096 
6 

As shown in Figure 2, the tdevlsion signal 10 may be rccch^ at a tuner (50 and 
demodulated at demodulator 70 prior to the extracting of the dosed caption infdraiatton at 
the processor. In addition, if scrambled, the ratavistan signal 10 wDl be faczanibled at 
desenmbkr 80 prior to the extracting of the closed cation infemiBiaoa. It should be 
appreciated those 

will also be necessary tor processing digital data stream*. This MPEO processor est be 
implemented as pan of processor 20 or as a separate protestor associated therewith. Those 
*ilied in the an appreciate thai the digital television signal J* forwarded torn (he video 
processor (VDP) on the bus to a graphic? processor, Next the signal is forwarded to a device 
that controls bus eind bur* inode digital vidw 

YB! insertion is performed (from the infbnnstioa forwarded to it) and finally digiial/aoalog 
(NTSQ convert ten is performed. 

In a preferred embodiment ofihe invcnJioc as stows in Figure 3 t user selected 
advanced closed captions are provided, dosed caption infonrarion is extracted (e-g„ by a 
closed caption processor 20) from a television signal 10, which television signal afao contains 
corresponding television programming. The processor 20 determines wbtfhar one or owe 
user selected attributes 12 have been set At teas; one user selected attribute 12 is applied to 
at least a portion of the dosed caption information (e^^ via a dosed caption driver :><>), The 
closed caption information is displayed (eg., viaa disptey driver 40 and grebes processor 
45) on a display deviee 50 (e,g., a television screen) in accordance with d* user selected 
attributes L2 via b graphical overlay on top of the television prograjoming, In this manne r, 
user selected advanced closed caption features can be provided using existing dosed caption 
Information contained within tht television signal. 

Hie invention may be unpieroentc d as part of a set-top terminal, & digital television* a 
personal computer, a digital video recorder, a digital video disk player, or other suitable 
device. Alternatively, the invention nay be implemented In a stand-alone device 20O as 

in Figure 3 which receives a television or other vid&> signal 10 and is coupkd to a 
display device 50. Hie user selected attributes may be applied to dosed caption information 
which is received (along with corresponding television programming) via a personal versatile 



on 



ftB92003-9096 



7 

recorder (PVR), a set-top teaninal, a digital tetevislnn, a persona] computer, a video-cassette 
recorder, a digital video recorder, a digital video disk player, or similar device, la the 
alterative, the television signal 1 0 comainmg the closed caption Infannation and asscc-ated 
. »lcvWoftpra C »mmiag maybe received viae delivery network, web at a cable or satsDite 
television network, a terrestrial network, toe Internet, or other ukeble communication 
aeswwk. Those skilled in the art will appreciate that &e television signals discussed herein 
include ant only traditional types of television signals, but also any non-traditional television 
signals containing closed caption or other textual data. For example, the television signal 10 
may comprise an analog signal, a broadcast or on-demand digital signal, smglecast or 
multicast streaming media, and the like. 

. The user selected attributes 12 tuny include font size, fbai type, font color, caption 
window position, caption window aize, prim direction, scroll direction, scroll raw, text 
opacity, background opacify, ^ justification kft, text justification right, text justification 
center, background color, and the like. 

Tlw closed caption mfbenttion may be displayed in one or atox closed caption 
box** Multiple closed caption bones may bo displayed simultaneously <e,g., for u*c with 
pictu«*b^ctur< fcamres cc to pro 
channel white viewiug a single television program). 

Toe closed caption infbrinatkm may be tagged wife an identifier that distinguishes it 
timm the television programmi^ data The closed caption Inibcznedon can then he extracted 
from the tekvlsion sxjnaf based on (he identifier. The television signal may comprise an 
MPEOOinunspoit stream. Tte^ 

of video data syntax of the trarspon stream. In sw*aa embodiment, extracting tbc 

closed caption utformatioa may be performed based on the usar data fidd. This applies uteo 
working with, for example, ElA^m standard doted caption information* hasam to the 
EIA-608 standard^ dosed caption byte* in DVS-157 ate delivered in the uaer_date syntax of 
the video syntax of DVS*0li which is compatibJe with the video syntax of A/53, an ATSC 
Digital Television Standard, The encode (at the origination location) incorporates the caption 
bytes, as forwarded via doe of its huaxlaces, following the syntax in iiserjdata of the video 
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syntax of a digital stream. The decoder (e.g„ sct^pp terminal), when decoding a digital stream 
receives these byte* in the aforementioned format, extracts fhem eni transsodes them as an 
EIA-608 VBI signal on the analog aignal This analog signal is a result of the decoder 
decoding the digital (MPEG-2) stream and converting it to an analog NTSC signal 

The cloafid caption infternajdoa may comprise one ofBA-608 closed caption 
Infbimatioa or HA-708 closed caption infonnaiiozL 

The user selected attributes can he cmered vie a pop-up ©onu, a dialogue box, a pull- 
d^rwnwii^wnicn^orctorsu^ for 
example, Figure 4 shows a menu 300 of user selectable dosed caption aoributcss Figure* 
show closed caption box attributes 305 ftzcb es box position JiO. box width 315, box heigfo 
320, bonier 325, opacity 330. hot color 335, priority 340. show caption box 345, lock tow 
growth 350 and lock column growth 355, Closed caption tost attributes 360 are also shown, 
tndudmg justification 365, font size 370, opacity 375, font type 380, fins color 38 S, and 
anchor point 39k Figure 5 shows a menu 400 of closed caption configuration tags, such as 
those provided pursuant to the ElA-708 standard, which indicate the type of text content being 
displayed. The tags 4 10 include indicators cf such as dialog (ROtxwd words spoken by 
characters in the programming), source or speaker identification (name of the speaker or 
source of sounds electronically reproduced voice (spokeo audio from a phone, radio, PA 
system, and the Uke\ dialog in language other than primary program language, voiceo ver 
(narration or other disembodied voice not heard by fee program's characters), aufible 
translation (voice cf disembodied translator not heard by the program's characters), snbtide 
translation (text showing a translation into the primary language of ihe program), voice 
quality description (description of a voice quality), song lyrics (words being sung), sound 
effect description (& description of a nonvestal sound or music being heard by the program's 
characters), muafcsJ score description (a description of background music not heard by the 
character's in the program), expletive (an mterjcnwy weed or expression, possibly profane or 
harsh). 
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Multiple attribute settings maybe provided aoch thai different user* can store their respectiw 
preferred attributes ft r future use. 

In « preferred embodiment of the invention, ihe processor 20 may dynamic*] \y 
determine the location of one or mm objects of interest in a displayed television scene Once 
an object of interest i* identified,, a! least one of the user selected attributes 12 can be wasted 
<x> make the presence of the dismayed closed caption mformaiioo less distracting based on the 
location of the one or more objects of interest 

TTie dosed caption ioforroation may be stored in memory 90. The dosed caption 
informftzta ma/ be stored on one of a personal versatile recorder, a digital Revision, a digital 
video recorder, a digital video disk player, a etHop terminal, & personal computer, or other 
sxritebte device. The user selected attributes \2 may include the option of autotnaticaJly 
generating a transcript of the television programming Sow fite stored closed caption 
information. The transcript may then be primed from an associated printer 100. 

User controlled replay of the stored cioaed caption information may be provided. On- 
screen review of closed caption text from Ac stored closed caption information may also be 
provided* which may be by a M screen display or b partial screen display. Page numbers, 
time mid date, and program utk may be inserted into the stored dosed caption information, 

Closed caption text from the stored closed caption inform art on may be transferred to 
writeabla media. The writeabfe media may comprise memory 90 contained vidua the same 
device which provides the ad vasced closed caption features, la fee alternative, the wdteable 
me6arasybclocar*dinadc*U* 

caption features* For example, the closed caption test from the stored dosed caption 
information may be rxBiurferred in Rkh T«t Format (RTF)) lo a personal computer 1 ID 
for storage on a hard drive, CO ROM, diskette, or any other sititifcle storage device. 
Similarly, the closed caption text may also be fcraferred to a printer 100, a personal versatile 
recorder (PVR) 120, a digital television, a dtgjtai video retordar, a digital video disk player, a 
set lop terminal, or o ther suitable device for Anther personal tusc or manipulation. 
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File management facta* nay be provided for multiple stored dosed caption files, 
whwtin each stored closed caption fib corresponds to a single television program. The file 
management functions my be provided by a parwwl versatile recorder 120, a digha! video 
recorder, a digital television, a digital video disk pkytt, a set-top terminal, a personal 
computer 110, or other suitable device. 

Bookmarks may be inserted and subsequently located in the dosed caption text of the 
stored closed caption inftanatiori byausarvia,^, remote contioL 

In an alternate embodiment, the currently displayed closed caption infunnflrion may be 
removed after a predeierniieed time period in which no closed caption tafcroaaoa is 
received. 

In a further embodiment of the iirvenrfan, dynamic a^ustmcat of etoscd caption text 
color is provided when & transparent closed capdon background is selected. When a. 
transparent background is selected, the dosed caption text is presented directly over the 
television proclaiming, As the color offce displayed television programming may change 
periodically, there exists th* possibly of conflict with the chosen color of the closed caption 
text By dynamically adjusting text eoJoz, die closed caption text *>iQ always be visible ever 
the television pr ogramndng, Those skQfed in the art will appreciate that such dynamic 
adjustment Is more appropriately provided at the arigiaationaite rather than at a destination 
location due to the difficulty in the processing (reaWme) which would bs required at the 
destination or viewing location. 

Unicode character technology may be utilized in order lo provide iaternatknaiizsitta 
of tea dosed caption intonation* Unicode is an intemezkmd standard for representing strings 
(concatenated characters) using 16-bit characters (65436 possible characters). Too Unicode 
standard allows for nan-English alphabet characters and graphical symbols. 

In an alternate embodiment of the invention, toe user selected attributes 12 may be 
automatically c^widden when an Emergency Alert Signal is received in order to avoid 
overly of the displayed closed caption intonation with a display of the Emergency Alert 
Signal. 
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The mfif ffilecttd'amllmfitt may be disabled on & per program baaii or 8 pw channel 

basis. 

It should dow be eppitdmed that the invention (sondes edvanugcots methods and 
apparatus whxh allow user sociable advanced dosed caption ft arum to be gsnetaad using 
existing closed caption infixmatkm. Further, the present invention accommodates both the 
KIA-608 standard and the EIA.7DS sfendaid descriptions. 

Although the invention Ms been described in connection with various ilhisuwd 
embodiments, numerous modifications and adaptations may be made thereto without 
departing from the spirit and aoopc of the invw^as»^lnd*d«nx3. 

< Br u) £escr i»t iaa of D f 3 « i 9t $ 
BRIEF DESCIUPTyffl pfTOF TO ^Wff^ 

The present invention will hereinafter be described in coqjuacaon with the appended 
drawing figures, wherein like numerals denote I** elements, and: 

Figure 1 shows £ block diagram of an exemplary embodiment of the invention; 

Figure 2 shows a block diagram of a further exemplary embodenem of the invention; 

Figure 3 shows a block diagram oft pitftned embodiment of the invention; 

Figure 4 shows an example of a mean box for entering the user selected advanced 
closed caption attribute*; end 

Figure 5 show* s ftrtber example of a menu box for entering additional user selected 
, advanced closed caption attribute*. 
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ASS23AEX 

Uwr cuBtomizabte advanced dosed caption capabilities fire provided using closed 
c&piicn infamaiion, such as that dtsoibtd In the Electronic Industries Association (ELA) 
Television Do* Systems Subcommittee standards* ElA-668 or EIA-70&. The invention 
allows the user to override the dosed caption p resentation format as selected by 4c originator 
{o.&» programmer or broadcaster), in order to select alternate praeoifitiou attributes bated on 
the usaft preference. The invention may aba be implemented to o^tomr™ cilierfomsof 
text information (eg., subtirka^ The invention aho allows for storage and subsequent 
retrieval and review of tem included wjihin the closed caption {nfba&atzoA, which text serves 
63 a txanscripc of the program. The methods and apparatus provided are independent of the 
type of delivery network, content fcanaf, end receiver type, Id an example embodiment! 
dosed caption uiformatioo is extracted («.g- by a closed caption processor 20) from a 
television signal 10, i*fcf ch television signal 10 also contains corxwpowfiag audiovisual 
programming. The processor 20 determines whether one or more user selected attributes 12 
have been ecl Ai least one user (elected Attribute 12 U applied to at least a portion of the 
dosed caption irtforrj&Ooa (*g* via a dosed captfeo driver 30), The closed caption 
imbrtnatico is displayed (e.g* via a display driver 40 and grapbia processor 45) on a dfaplay 
device 50 (e,g^ a television screen) in accordance with the user selected attributes 12 via a 
graphical overlay on top of the aodiovisuaJ programming, In this vmsm, user selected 
advanced closed caption features can be provided using existing closed caption (nfonxatioa 
cottained In die television signal 

? Ee?r<?<el*l i t r Dr a«4 of 
Fig. 1 



